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Abstract — We consider the setting of data storage across n 
nodes in a distributed manner. A data collector (DC) should be 
able to reconstruct the entire data by connecting to any k out of 
the n nodes and downloading all the data stored in them. When a 
node fails, it has to be regenerated back using the existing nodes. 
An obvious means of accomplishing this is to use a Reed-Solomon 
type MDS code where each node stores a single finite field symbol 
and where one downloads the entire file for regeneration of a 
failed node. However, storing vectors in place of symbols makes 
it easy to extract partial information from a node, and helps in 
reducing the amount of download required for regeneration of 
a failed node, termed as repair bandwidth. 

Recently, there has been additional interest in storing data in 
systematic form as no post processing is required when the DC 
connects to the k systematic nodes. On failure of a systematic 
node, there is a need to regenerate it back quickly and exactly 
due to their preferred status. Replacement of a failed node by 
an exact replica is termed exact regeneration. 

In this paper, we consider the problem of minimizing the repair 
bandwidth for exact regeneration of the systematic nodes. The file 
to be stored is of size B and each node can store a — B/k units 
of data. A failed systematic node is regenerated by downloading 
/3 units of data each from d existing nodes. We give a lower 
bound for the repair bandwidth for exact regeneration of the 
systematic nodes which matches with the bound given by Wu 
et al. For d > 2fc — 1 we give an explicit code construction 
which achieves the lower bound on repair bandwidth when the 
existing A; 1 systematic nodes participate in the regeneration. 
We show the existence and construction of codes that achieve the 
bound for d > 2k — 3. Here we also establish the necessity of 
interference alignment. We prove that the bound is not achievable 
for d < 2k — A when /3 = 1, except for the case when a = 1 for 
which any [n, k] MDS code will trivially achieve the bound. We 
also give a coding scheme which can be used for any d and k, 
which is optimal for d > 2fc — 1. 

I. Introduction 

Consider a scenario where a file of size B is to be stored 
in a distributed manner across n storage nodes. A data 
collector (DC) should be able to reconstruct the entire file 
by downloading data stored in any k out of n nodes. Each 
node can store a units of data (symbols) given by 

a = B/k (1) 

When a node fails, the failed node has to be regenerated back 
by downloading j3 symbols each from d existing nodes as 
shown in Figure [T] We consider the problem of minimizing 
the repair bandwidth for exact regeneration of the systematic 
nodes. 

Consider the exact regeneration of a systematic node, say 
node / by connecting to some set of d nodes. Each symbol 




Fig. 1. An illustration of exact regeneration: On failure of node 5, data from 
nodes 1 to 4 is used to regenerate back the same data that node 5 earlier had. 

Stored is a linear function of the source symbols. By ([T]| 
the linear functionals associated with the symbols stored in 
any fc — 1 of the d nodes are linearly independent of those 
associated with the symbols of node I. Hence an additional a 
linear functionals are necessary to exactly regenerate node /. 
From this it follows that a lower bound on the repair bandwidth 
d(5 is given by 

dl3>a + {k-l)(3 (2) 
In particular, for /5 1 we have 

d>a + k-l (3) 

Our focus in the current paper is on the case j3 ~ \. Given 
a construction for /3 = 1, constructions for larger (3 can be 
obtained by partitioning the data into smaller chunks, and 
encoding them individually using the construction for /? = 1. 
As reconstruction and regeneration are performed separately 
on these smaller chunks, additional processing and storage 
required is greatly reduced. 

In general, it is an open problem whether this lower bound 
is achievable for the problem of exact regeneration of the 
systematic nodes, and we address this issue in the present 
paper For a = 1, we get B = k and the lower bound as 
d > fc. In this case, any [n, fc]-MDS code will achieve the 
lower bound for exact regeneration. Hence, we will consider 
a > 1 throughout. We have categorized the (fc, d) parameter 
set with respect to the lower bound on repair bandwidth in 
Figure [2] 

In an independent work [2], authors consider the same 
setting and provide constructions for codes corresponding to 
a repair bandwidth that is significantly higher than the lower 
bound on repair bandwidth. 

We say a code is optimal exact regenerating if it achieves the 
the lower bound on repair bandwidth for the exact regeneration 
of systematic nodes. The non-systematic nodes are not the 
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Fig. 2. Categorization of the (fc, d) parameter set 

focus and hence their regeneration is not considered in detail. 
We assume the naive strategy of downloading the entire file 
for the exact regeneration of the non-systematic nodes. 

The pioneering paper in this area [1] considers a more 
general setting in which each node stores slightly more data 
than the minimum required, namely a = {B/k)v for some 
1/ > 1, in order to reduce the repair bandwidth. In this scheme, 
the regenerated node need not be identical to the failed node 
as long as it maintains all the properties of the system. The 
authors establish a tradeoff between the amount of storage in 
each node a and the repair bandwidth d/J. In the present paper, 
we are interested only in the case v ^ \ which corresponds 
to the Minimum Storage Regeneration (MSR) point on the 
tradeoff. The bound given in equation Q matches with the 
MSR point on the ti-adeoff. 

In our previous work [3], we also considered the problem 
of exact regeneration, however for that value of > 1 which 
minimized the repair bandwidth. We gave explicit codes for 
the other extreme point on the tradeoff, and an approximately 
exact regenerating code for the MSR point, both of which 
minimized the repair bandwidth at the respective points. 

In the rest of the paper, the results are presented in terms 
of k and a, as this leads to a more intuitive understanding of 
the codes. In Section |ll] we give a subspace viewpoint which 
will be used throughout the paper. Explicit and optimal code 



constructions for fc < a are given in Section III The existence 
and construction of optimal codes for fc < a + 2 is given in 
Section IV In Section [V] we prove that the lower bound in 
not achievable for fc > a + 3 with P — \. A coding scheme 



for any (fc, a) parameter set is provided in Section VI which 
is optimal for k < a. 

II. Subspace Viewpoint for Linear Codes 

We consider only linear codes in this paper. By a linear 
code, we mean that any symbol stored is a linear combination 
of the source symbols, and only linear operations are allowed 
on them. Define a vector z of length B consisting of the source 
symbols. Let 



where Zj is a column vector of length a. Each source symbol 
can independently take values from Fg, a finite field of size q. 
Hence, the B source symbols can be thought of as forming a 
_B-dimensional vector space over F^. 

Since the code is linear, any stored symbol can be written 
as fz for some column vector L These vectors which specify 
the kernels for the stored symbols define the code, and the 
actual symbols stored depend on the instantiation of z. Since 
a node stores a symbols, it can be considered as storing a 




Fig. 3. Exact regeneration of systematic node I 

vectors of the code, and hence can be represented by a a x i? 
matrix. We will say that the node stores this matrix. 

Linear operations performed on the stored symbols are 
equivalent to the same operations performed on the corre- 
sponding vectors. Hence storing an ax B matrix is equivalent 
to storing a subspace of dimension at most a. However, 
from ([T]) it is clear that each node must store a subspace of 
dimension at least a. 

1, . . . ,n denote the matrix stored by node ni 
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1, . . . , fc are a X a matrices. The a symbols stored by node 
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We will denote the j row of 
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There are n storage nodes, out of which fc are systematic 
and store a data symbols each in uncoded form. For to = 
1, . . . , fc, systematic node m stores the symbol set Thus 
for I = 1, . . . , fc. 
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la if ^ = TO 

Oq if I ^ m 



(4) 



where Oq is a x a zero matrix, and /„ is a x a identity 
matrix. Hence, for any non-systematic node to, g|'"'' denotes 
the components along systematic node I that are stored in node 

TO. 

For regeneration of a failed systematic node, d other nodes 
provide one symbol each. We say that each node passes a 
vector for the regeneration of the failed node. In the vectors 
passed by the non-systematic nodes, the components along the 
existing systematic nodes constitute interference. 

Let D denote the set of d existing nodes used for regen- 
eration of systematic node /. Let Vp"'''' = • • • Vn'fc'''] 
represent the vector passed by node to e D for the re- 
generation of node Z ^ D (as shown in Figure |3]l where 
Wp™'''', {i — 1, . . . , fc) is an a-length row vector representing 
the component along the symbols of the systematic node i. 

, fc, i ^ I) constitute interference. 



Thus, v^i^\ (i = 1 



Let X 
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Xq"^''*! be the coefficients of the linear 



combination of the rows of G*^™^ to obtain the vector that node 
TO passes for regeneration of systematic node I. For brevity, 
we will discard the subscript D from the notation and the set 
of d nodes being used for regeneration will be clear from the 
context. Thus, 
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Throughout this paper, we use superscripts to refer to the 
node numbers, and subscripts to index the elements of any 
matrix. No distinction is made between row and column 
vectors and the orientation of the vector under consideration 
is clear from the context, represents an a-length unit vector 
with 1 in i*'* position and elsewhere. We say two vectors 
are aligned if they are linearly dependent. 

III. Optimal Explicit Code for k < a 

In this section an explicit linear construction is given, which 
achieves optimal exact regeneration of systematic nodes for 
k < a. The construction assumes that when a systematic node 
fails, the existing k — 1 systematic nodes along with any a 
non-systematic nodes participate in the regeneration. First, we 
provide a code construction for k = a. Codes for any k < a 
can be obtained by modifying the code for k = a. Initially, a 
simple example is given to illustrate the code. 

A. Example 

Take k = a = i. This gives rf = 5 and B = 9. Thus each 
node stores a 3 x 9 matrix. Let n = 6 and q = 7. 
Let the first three nodes be systematic. Hence, 

G(^) = [/3 O3 O3] (6) 
G(2) = [O3 73 O3] (7) 
G(3) = [O3 O3 h] (8) 



be a 3 X 3 Cauchy matrix 



[5J. Any submatrix of a Cauchy matrix is fuU rank. 

The three non-systematic nodes store the matrices 

Q(m)^ 771 = 4^ 5^ 6, given by 
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1) Regeneration: For the regeneration of systematic node 
I (g {1,2,3}), each non-systematic node passes its Z*'* 
row. The choice of the non-systematic node matrices is such 
that in the vectors passed for regeneration of a systematic 
node, components along the existing systematic nodes (which 
constitute interference) are aligned. For example, consider 
regeneration of systematic node 1. Each non-systematic node 
passes its first row. First rows of G^™', m = 4,5,6, 
have components along the systematic nodes (nodes 2 and 
3) aUgned in the direction [1 0]. Now, the second and 
third systematic nodes pass [0 00 10000 0], 
and [0 0000010 0] respectively and cancel 
out the interference leaving behind the matrix [if 3 O3 O3]. 
Since ^'3 is invertible, systematic node 1 can be exactly 
regenerated. 

2) Reconstruction: To reconstruct the entire data, DC can 
connect to any three nodes. For reconstruction to be possible, 
the 9x9 matrix formed by juxtaposing the node matrices of 
these three nodes one below the other should be non- singular. 

Reconstruction is trivially satisfied when the data collector 
cormects to all the three systematic nodes. Suppose, the data 



collector connects to two systematic nodes and one non- 
systematic node. For example, suppose DC connects to nodes 
2, 3 and 4. For reconstruction, we need the following matrix 
to be non-singular: 
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(9) 



which is full rank since the elements of a Cauchy matrix are 
non-zero. 

Consider the data collector connecting to one systematic 
node and two non systematic nodes. For example, suppose it 
connects to nodes 1, 4, and 5. Since all symbols of node 1 
are available, g'{^^ and G^^ can be cancelled out. Hence for 
reconstruction to be possible the matrix Si given below must 
be full rank. 



Bi = 



Gf 



Gf 



Claim: The matrix is full rank. 
Proof: For i = 2, 3, 1 (in this order), group the i*'* rows 
of the two non-systematic nodes together to give matrix 
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Cauchy matrix "if 3 and hence is 
invertible. Multiply the three groups of two rows each by ^f^^ 
to obtain 
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where </> is some arbitrary value. Rows 1, 4, 5, 6 (and columns 
1, 2, 4, 6) are linearly independent of all others (this includes 
all the columns containing </>) and hence be eliminated to 
obtain. 



Ba 



2 1 
1 2 



which is full rank. ■ 
Now consider the case of DC connecting to three non- 
systematic nodes. Let Ci be the matrix formed by juxtaposing 
the matrices stored in these three nodes one below the other. 
Claim: The matrix Ci is full rank. 
Proof: In Ci, group the i*'* {i = 1,2,3) rows of all the 
three nodes together to obtain the matrix C2. Thus, 
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Multiply the 3 groups of 3 rows each by ^'3 ^ to get a matrix 
C3 given by 
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Rows 1, 2 and 3 in the groups 1, 2 and 3 respectively (i.e 
rows 1, 5 and 9) are clearly independent of all others (and so 
are the corresponding columns). The remaining 6x6 submatrix 
can be rearranged to get the following form: 
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This is a block diagonal matrix, and since q = 7, is full rank. 
Thus the matrix Ci is full rank. ■ 



B. Explicit General Code Construction for k = a 

Let be an (n — fc) X a Cauchy matrix [5] with elements 
drawn from F„. i.e, 



As illustrated in the example, this choice makes the inter- 
ference in the vectors passed by non-systematic nodes for the 
regeneration of a failed systematic node aligned. This enables 
the existing systematic nodes to cancel the interference by 
passing one symbol each. 

7 ) Regeneration: Consider regeneration of systematic node 
1{G {1, . . . , k}). All non-systematic nodes who participate in 
the regeneration pass their Z*'* row, i.e. if non-systematic node 
m{E {fc + 1, . . . , n}) participates in the regeneration, then it 
passes 
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The systematic node I [l = 1, . 

y!-^''^ = [0 ... 

position. 



, fc, I ^ I) passes 
iO.-.O] 



(16) 
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with e,- in the I 



th 



From equation i 
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ill 



are all aligned along the direction 



of gj. Hence v 



where 



(i) 



/c + 1 , . . . , n are a-length 



row vectors. Any submatrix of a Cauchy matrix is full rank. 
The minimum field size required for the construction of this 
Cauchy matrix is: 

q>a + n-k (14) 



Note that since n 
For m — k + 1, 



(m) _ 



fc > a > 2, we will have q > 4. 
. , n, i, J = 1, .... a, set 

£-0'™^ if i = J 



I (™) 



(15) 



where e is any arbitrary value such that e 7^ and ^ 1. 
Note that there always exists such a value if q > 4. 



can be used to remove interference along 
the systematic node / from v^™''^ Vm participating in the 
regeneration. 

Also from equation JlsL g~^~^ are rows of the Cauchy 
matrix and hence are~[inearly independent. Using these 
a linearly independent vectors, the systematic node I can be 
regenerated. 

2} Reconstruction: For reconstruction to be successful, the 
matrices stored in the fc nodes to which the DC connects, 
when juxtaposed one below the other, should form a B x B 
full rank matrix. Call this the reconstruction matrix R. If the 
DC connects to the fc systematic nodes, then reconstruction is 
trivially satisfied. Consider DC connecting to p non-systematic 
nodes, and fc — p systematic nodes, 1 < p < fc. Let Si, . . . ,dp 
be the p non-systematic nodes to which DC connects and let 
fii, . . . ,ilp (fii < . . . < Hp) be the p systematic nodes to 
which DC does not connect. 

Reconstruction is successful if and only if the pa x pa 
matrix R formed by components along systematic nodes 

is non-singular 



(18) 



Theorem 1: R is full rank. 

The proof of Theorem [T] is provided in Appendix. The 
steps followed in the proof are similar to the ones used in 
the example. 



C. Explicit Code construction for k < a 

For a given (fc, a) first construct the code for k — a. The 
theorem given below shows the existence and construction for 
any k < a. 

Theorem 2: If there exists a (fc, a) linear code for exact 
regeneration of the systematic nodes, then there also exists a 
(fc, a) linear code for any fc < fc. 
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Proof: Suppose there exists an {k^a) code for exact 
regeneration of the systematic nodes. From each node matrix, 
remove the last {k — k)a columns so that now G'™' is of 
the size a x ka. Thus, we will have B = ka data symbols. 
Consider only the set of first k systematic nodes and all the 
non-systematic nodes. This forms a (k, a) code. 

Reconstruction: Suppose the DC connects to £ systematic 
nodes and k — £ non-systematic nodes. This case is same as 
the case in original (fc, a) code where the DC connects to 
the removed k — k systematic nodes along with the above £ 
systematic nodes and k — £ non-systematic nodes. Hence, the 
DC can reconstruct B data symbols. 

Regenration: During regeneration of a systematic node, we 
have d = a + fc— 1 — d ~ {k ~ k). All the a non- 
systematic nodes participating in the regeneration pass exactly 
the same vector as in the original code. Since the last {k — k)a 
column sets have been removed from the non-systematic 
node matrices, there is no interference from the data symbols 
corresponding to the removed k — k systematic nodes. All the 
interference which is present are aligned and the components 
along the failed systematic node span an a-dimensional space 
as in the original code. Hence k~k lesser vectors will be able 
to regenerate the failed node. ■ 

Remark: The above construction is optimal for /3 = 1. 
For any higher f3, the data to be stored can be split into 
smaller chunks, which can be encoded individually using this 
construction for /? = 1. Hence, this construction is optimal for 
any value of /3. 

IV. Existence and construction eor k < a + 2 

The existence and construction of exact regenerating codes 
which meet the bound given by (j3]l is shown for the parameter 
set A; < a + 2. This proof assumes that when a systematic 
node fails, the existing k — 1 systematic nodes participate in 
regeneration along with any a non-systematic nodes, passing 
one symbol each. The proof can be extended to the general 
case as well, where any d existing nodes can participate in the 
regeneration. 



A. Approach 

In the sequel the reconstruction and regeneration conditions 
will be cast as product of rational polynomials. We will need to 
show that there exists a set of non-zero values such that these 
polynomials are all well defined and non-zero. In [4] a similar 
problem is arises in proving the existence of capacity achieving 
multicast network codes, but with respect to polynomials. But 
the argument can be easily extended to rational polynomi- 



als. If 



/p(3l) 



— , . . . , — are rational polynomials, then define 
fp+i{x) — gcd{gi{x), . . . , gp{x)). There exists a solution to 
X such that the product of the rational polynomials is well 
defined and non-zero if and only if there exists a solution to x 
such that the product of the polynomials fi{x), . . . , fp+i{x) is 
non-zero. Hence, the algorithm given by Koetter and Medard 
in [4] can be used to find the values of the variables, provided 
the field size is large enough. 



B. Necessary Properties 

1 ) Necessary Properties for Reconstruction: 
Lemma 3: For reconstruction property to hold, for any non- 
systematic node m, g["^^ must be full rank V/ G {!,..., k}. 

Proof: Given some m and I, suppose the DC connects 
to the fc — 1 systematic nodes other than /, and to the non- 
systematic node m. From the fc — 1 systematic nodes, the 
DC recovers (fc — l)a data symbols. Hence column sets 



corresponding to these k — 1 systematic nodes (i.e G 



(m) 



I = 



1, . . . ,k I ^ I) can be removed from G*-™^ leaving behind 
only g|'"'. Thus, for successful reconstruction, 



g["^ should 



be full rank. ■ 

2) Necessary Properties for Exact Regeneration: 
Lemma 4: For the regeneration of a failed systematic node 
I (e {!,..., fc}), the components along node I in the vectors 
passed by the a non-systematic nodes participating in the 
regeneration must be linearly independent. 

Proof: Consider the regeneration of a failed systematic 
node I, by connecting to fc — 1 existing systematic nodes 
mi, . . . , nik-i and a non-systematic nodes to^., . . . , rrife^i+Q. 
Let matrix 

■u("'i,0 



r(mfc-l + a,i) 



(mi,;) 



Vk 



(19) 



where K = 



{i — 1, . . . ,k) is a dx a ma- 



trix representing the component of V along the i systematic 
node. For successful regeneration of I, we need an a x c? matrix 
Y such that 

YV = G(') (20) 

Consider the component of FV along node I. Since cj''' — /„, 
we need rank{YVi) > a. Since the fc — 1 other systematic 
nodes cannot provide any vector in the direction of I, we get 
_ g fQj. j^j^j _ l,...,fc, i ^ m, / ^ m. Thus the 
first fc — 1 rows of Vi are 0. Hence, the remaining a rows 
of Vi, which are the components along the failed node in the 
vectors given by the non-systematic nodes, have to be linearly 
independent. ■ 
Remark: Since only the last a rows of V/ are non-zero, the 
last a columns of Y should also be linearly independent. 

Lemma 5: (Need for Interference Alignment) For the re- 
generation of a failed systematic node /, and for any I e 
1, . . . , fc, i ^ I, the vectors v'f^''^\ Vm e {fc + 1, . . . , n} 
should be aligned. 

Proof: Using the same notations as in Lemma|4] consider 
the components along any other systematic node 1. Since 
= Oct, we need YV^ = 0. Since the other fc— 2 systematic nodes 
provide component along node I, the corresponding rows of 
Vi will be zero. Let {a + 1 x a) and Y (a x a + 1) be 
sub-matrices of VJ- and Y with the fc— 2 zero rows in V^- and the 
corresponding columns in Y removed. Thus we need YVj = 0. 
Since rank{Y) > a, it forces ranfc(Vj-) < 1. Hence, for the 
regeneration of a systematic node, in the vectors passed by the 
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a non systematic nodes, the components along any existing 
systematic node should be aligned in the same direction. By 
choosing different sets of a non-systematic nodes, we get that 
aUgnment should hold for all the non-systematic nodes. ■ 

Theorem 6: A necessary and sufficient condition for exact 
regeneration of a failed systematic node I by connecting to the 
existing fc — 1 systematic nodes and a non-systematic nodes 
is that the set of vectors passed by these non-systematic nodes 
satisfy Lemmas |4] and |5] 

Proof: Necessity: Proved in Lemmas |4] and |5] itself. 
Sufficiency: Suppose Lemma|5]is satisfied. Then, in the vectors 
passed by the non-systematic nodes, the components along 
any other systematic node I are aligned in the same direction. 
I.e. v~ — w~ where m is any non-systematic node, 

is a vector independent of m, and k's are some constants 



,{1,1} 



w^P with the 



in ¥q. The systematic node I passes 

components of v^' '' along other nodes as 0. Hence, this can 
be used to subtract the component in v*^™ along any other 
systematic node I, to give a set of vectors 

fc 



Jrn,l) 



J2 ^^^''V^*-') 



(21) 



Since v 



''^'^ - for [ = 1, . . . , fc, I ^ I, we get wl"''^ - 



I 1 : , , , ' ^ 1 

. Since Lemma Wis satisfied, the components of these 
a vectors along node / are independent, and hence span the 
a-dimensional subspace stored in node /. ■ 



C. Structure of the Code 



For m = fc + 1 , . . . , n let, 

M^.M (m)^ z = l,...,fc 



(22) 



where a|™^ = diag{\i'l' , . . . is an a x a diagonal 

matrix and 



(m) 



H, 



(m) 



(m) 
a 

(m) 



(m) 



,(™) 



(23) 



where liff^ is an a-length row vector. Also set 



(24) 



Regeneration: For m = fc + 1, . . . , Z = 1, . . . , fc, let 

^(m,/) ^ ^(mJ)Q(™) (25) 

For ^ = 1, . . . , a, set 



6; Vm g {fc + 1, . . . , 



(26) 



i.e. for regeneration of the systematic node /(e {1, . . . , a]), 
each non-systematic node passes the row of its node matrix. 



Thus to satisfy Lemma |5] we choose. 



h 



(m) ^ 

i,3 



TO = fc + 1 , . . . , n 
i = 1, . . . ,a, 
j = l,...,fc, j^i 



(27) 



Thus, for regeneration of systematic nodes 1 , . . . , a, the inter- 
ference is aligned, and hence can be subtracted out. 

Reconstruction: The DC connects to any set of k nodes and 
downloads all the ka data symbols stored in them. 

D. Existence and construction for k ~ a + 2 

Consider regeneration of the systematic node a + 1. By 
Lemma |5] the component along the systematic node I, Vl E 
{1, . . . ,a} in the vector passed by non-systematic nodes need 
to be aligned in one direction. This leads to the following set 
of n — fc — 1 equations: for m — k + 2, . . . ,n, 

^{m,a+l)^(k+l,a+l)Qik + l) _ ^{rn,a + l) Qim) ^^^^ 

Similarly, alignment for the regeneration of the systematic 
node a + 2 leads to another set of n — fc — 1 equations: 
TO = fc + 2, . . . , n. 



K 



for some constants ks e ¥q. 



Set 



(m,a+l) 



{m,a+2) 



(say) 



(29) 



(30) 



For all TO e {fc + 2, ...,n}, multiply equation (28 i by 



(m,a+l) 



)-i and (29 1 by ( 



(m,a+2) 



) ^ and subtract the two. 



h[^^ gets eliminated and a homogeneous equation in terms of 

hi,i, ■ ■ • h'i'^i^^\ hi+ij, ■ ■ -^Kj remains. One way to 

satisfy this equation is to equate all the scalar coefficients to 
zero. 

This gives, for I — 1^ ... ,a, m — k + 2, . . . ,n and i — 

l,...,a,ij^l, 



,(m)_ (m),(fe+l) 



^^(m,a+l)^_l_^(fe+l,a+l) ^^{m,a+2)yl 



(k+l,a+2) 



(^1 



(m,a+l) {m,a+l) / (m,Q+2) wl (m,Q+2) 



(31) 



Equation (31 1 ensures that second set of equations (i.e. 29 1 
are satisfied whenever the first set (i.e. [28] l is satisfied. 

Note that any polynomial containing a A^™'' {i ^ I) term 
will be a rational polynomial. For such polynomials, we will 
obtain an assignment which will simultaneously ensure that 
none of the inverted terms are zero, and the polynomial is 
also not zero. 

Now only the first set of equations have to be satisfied, for 



which, using equation ( 28 i make the following assignments, 
for TO = fc + 2, . . . , n 

4(7) ^ (:e|'"^"+^V1[«|™){/i['=+^)-^('=+^'"+^)- 



•^1,1 



(m) (m,a+l) , 



(32) 



7 



The component along systematic node a + 1 needs to be 
aligned in the vector passed for the regeneration of systematic 
node a + 2 and vice versa. Hence the alignment of systematic 
nodes a + 1 and a + 2 result only in one set of n — — 1 
equations each. Consider the regeneration of the (a + 2)*'* 
systematic node. By Lemma [5] the the component along 
the (a + 1)*'* systematic node in the vector passed by non- 
systematic nodes need to be aligned in one direction. This 
leads to the following set of n — fc — 1 equations: For 
m = k + 2, . . . ,n, 

^(™) „(fc+l,Q+2) TT{k+l) A (fc+1) _ (m,Q+2) rr("i) A ("!■) 



By equation ( 27 1 we have 



rr('n) _ 7:r(fe+l) _ tt 



(say) 



Thus, equating the coefficients to zero, we get for i = 1, . 



A, 



(m) 



^(m) (fe+l,Q+2) ^(fe+l)^^(m,Q+2) 



(34) 



(35) 



Similarly, for regeneration of node a + 1, we need to align 
components along node a + 2 which leads to 



A, 



(m) 
i,a+2 



(m) ^(fe+l,Q+l)^(fe+l) ^^(m,Q + l) 



^Q + 2'' 



i,a+2 



(36) 



Regeneration: Exact regeneration of each one of the systematic 
nodes I E {I, . . . ,a} results in a condition 



det 



^0 



(37) 



\ -Id / 



where mi, . . . ,ma are the a non-systematic nodes used for 
regeneration After substituting for /i; ; ^ ~ 1, • ■ • , a from 
equation ( [32| , this condition evaluates to a rational polynomial, 
which can be shown to be not identically equal to zero by the 
following assignments: 



1. 



X 



{k + l,a+l} 



(fe+l,Q + 2) 



(m,a+l) , (m,Q+2) 
X; — 1, X; 

^(m,a+2) _ _ i,^-] 



X. 



(fe+l,a+l) _ 

X; — i 

(m,Q + l) -, 



(m- k) ^ + 1 



(38) 



for i ~ I, . . . , a, i ^ I, me {mi, . . . , mc}, m 7^ fc + 
1 and j = i if i < I, j = i — 1 if i> I. This set of 
assignments makes the matrix under consideration in equation 
dSTli a Vandermonde matrix which is full rank, and ensures 



that equations ( 3 1 1, ( 35 1 and ( 36 1 remain valid, provided the 
field size is large enough. 

Exact regeneration of systematic nodes a + 1 and a + 2 
also result in conditions of rational polynomials being not 
equal to zero. For exact regeneration of (a + 1)*'* systematic 
node. Lemma l4 should hold. Choose Ha+i to be a full rank 
matrix. Lemma 4] implies that the coefficients resulting from 
the linear combinations need to be linearly independent, i.e 
g^{m,a+i) ^{^^ should be linearly independent for any a out 
of the n — k non-systematic nodes. Express the determinant of 
this matrix as a polynomial. To show that this polynomial 



is not identically zero, we choose A)^ 



(fe+i) 



/, K 



(m) 
a+l 



1 Jiri,a+2) _ -, 

-L, Xj -L, 
fc + 2, . . 

From (BSl, 



(k+l.a+2) 



= 1 for i = 1, . 



t A (™) 

we get A^/i 



= /. Choose x\'^'°'~^^^ ~ (jn — 
n to make it a Vandermonde matrix 



fc)* for m = fc + 1, 
(also ensuring that equations ( 3 1 1, ( 35 1 and ( 36 1 remain valid), 
provided the field size is large enough. A similar argument can 
be used to obtain a condition for regeneration of node a + 2. 

Reconstruction: The condition for reconstruction property 
to hold can be expressed as a product of polynomials not 
being equal to zero by viewing each determinant as a polyno- 
mial. For reconstruction to be successful, the node matrices 
corresponding to the fc nodes to which the data collector 
connects, when juxtaposed one below the other, should form 
a B X B full rank matrix. If the data collector connects to the 
fc systematic nodes, then reconstruction is trivially satisfied. 
Consider DC connecting to p non-systematic nodes and fc — p 
systematic nodes, 1 < p < fc. Let mi,..., nip, (mi < 
. . . < nip) be the non-systematic nodes to which it connects. 
Let li, . . . ,lp, {li < . . . < Ip) he the p systematic nodes 
to which it does not connect. Due to the structure of node 
matrices of the systematic nodes, we will be left with the 
condition of the la x la matrix formed by the column sets 
li, . . . ,lp of the node matrices of the p non-systematic nodes 
being non-singular Thus the polynomial corresponding to this 
choice of fc nodes is 



det 



\ 



G 



G' 



(39) 



We will now show that there exists an assignment of the 
variables such that this polynomial is not identically zero. For 

1,2 = 1, ■ • . ,p, mi 7^ fc + 1, set 

1 ifi^i 
if 1^3 



(40) 



1 



For i = 1, . . . , a, m = k + 2, . . . ,n,l — 1, . . . , fc set 

(m',a+2)* 



H'l^'' = I, A; 

_^(fc + l,Q + 2) _ 



1, 



1, X 

[m — ky. Thus from (|31 



( 32 1, ( 35 I and ( 36 1, we get that this matrix is full rank for a 
large enough field size, and also the equations pT) , ( [35] l and 
( |36l ) remain valid. 

Hence, provided that the field size is large enough, one can 
find solutions for these variables such that both reconstruction 
and exact regeneration properties are satisfied. 



E. Existence and construction for fc < a + 2 

For a given a, the code described for the previous subsection 
can by modified using Theorem |2] to obtain a code for any 

fc < a + 2. 

Remark: This achievability scheme is optimal for (3 — 1. 
For any higher (3, the data to be stored can be split into 
smaller chunks, which can be encoded individually using this 
construction for /3 = \. Hence, this for any value of j3, optimal 
regeneration for the parameter set fc < a + 2 is achievable 
using this scheme. 
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V. NON-ACHIEVABILITY FOR k> a + 3 

We define two codes to be equivalent if the corresponding 
nodes of both codes store the same subspace, and pass the 
same vectors for regeneration of any node. The only difference 
may be in the representation of what is stored in a node, i.e. 
in the node matrices. 

Lemma 7: If there exists an exact regenerating code for fc > 
a + 1, then there exists an equivalent code with the following 
property: 



= hi J, for i 



1, 



,a, j = l,...,k, ,j (41) 



for any non-systematic node m. 

Proof: Consider a code which performs exact regenera- 
tion of the systematic nodes. For any non-systematic node m 
in this code, we will obtain linearly independent vectors in the 
subspace stored in it one by one, and set them as the rows of 
its node matrix. By induction we will prove that the matrix of 
any node will take the following form: G*^™^ = 



,(m), (m) 
^1,1 



, (m), (m) 



-^l,Q + li5;l,Q + l 
'^2,Q + li!;2,Q + l 



x'™' h 



(42) 

(m) 
/ 



for m = fc+ 1, . . . , n. Note that by Lemma [i] ij/'"^ and A, 
have to be full rank matrices. 

Let the first row of G*^™^ represent the vector passed by 
the non-systematic node m for the regeneration of the first 
systematic node. From Lemma [5] as the interference from the 
remaining k — 1 systematic nodes has to be aligned. 



— hiji J — 2, . . . , fc 



(43) 



Hence, the first row has to be of the given form. Suppose 
the vectors passed for the regeneration of systematic nodes 
l,...,p — l{l<p<a) are linearly independent in all the 
non-systematic nodes. By a similar argument, the first p — I 
rows of G^'"-' have to be of the given form. 

Now consider the regeneration of the p*^ systematic node. 
Suppose some of the non-systematic nodes (say type A) pass 
a vector linearly dependent on the first p — 1 rows of their 
node matrix and some (say type B) pass a linearly independent 
vector Each type B node will have this vector as a new 
row in their node matrices. In this set of vectors passed for 
regeneration of the p*^ systematic node, consider the com- 
ponent along systematic node (a + 1), i.e. v^^^K In vectors 
passed by type A nodes, this vector is a linear combination of 

^^i, i = 1, ■ ■ ■ ,p—l, whereas in vectors passed by type B 
nodes, it is linearly independent of i — 1, . . . ,p — 1 

(by Lemma |4]l. But by Lemma |5] these vectors have to be 
aligned. Hence there is a contradiction. 

Suppose all the non-systematic nodes are of type A. Then 
all the vectors passed by non-systematic nodes will be linearly 
dependent on the first 1 rows of their node matrices. Hence 
in all the vectors, the component along systematic node p 
Wp™'^"* will be a linear combination of h^^, i = 1, . . . — 1. 
These can span at most p — 1 dimensions whereas p*'* 
systematic node spans a dimensions. Hence the regeneration 



of p*'* systematic node is not possible. 

Hence all the non-systematic nodes should be of type B. i.e 
they pass linearly independent vectors for the generation of 
systematic nodes. Along with Lemma [5] this proves that all a 
rows of the node matrix have to be of the given form. ■ 

Henceforth in this section, we will consider all nodes to be 
of this form. 

Remark: In this code, for the regeneration of the p*'' 
systematic node (for 1 < p < a), each non-systematic node 
passes the p*'' row of its node matrix. 

Corollary 8: For I = a + 1, . . . , k, and any non-systematic 
nodes m and m', 

(44) 



Corollary 9: For any non-systematic node m and k > a+1, 
any a out of v(™'^\ . . . , v'™''^) are linearly independent. 

Proof: In the code given in Lemma |7j the choice of the 
first a systematic nodes was arbitrary. Hence, for a given set 
of a systematic nodes, an equivalent code can be constructed 
considering these as the first a nodes. Thus, by Lemma [7] the 
vectors passed by any non-systematic node for regeneration of 
these systematic nodes will be the a rows of its matrix. Hence 
they are independent. ■ 

Lemma 10: For k > a + 2, for any non-systematic node to, 

(m,/) 



7^0 for 



.,a 



Proof: Suppose for some non-systematic node to, I E 
{a + l,...,k} and i e {!,..., a}, a;^™''-* = 0. Since for 
j(e {!,..., a}), v'™'^^ is the j*'' row of the node matrix 
of node m, v^™''^ is a linear combination of v*^™'-'^ j = 
j ^ i- This is a contradiction to Corollary |9] ■ 
Theorem 11: For a linear code with /? = 1, exact regener- 
ation of systematic nodes meeting the bound given by Q is 
not possible for fc > a + 3. 

Proof: (By contradiction) Consider any code that achieves 
exact regeneration of systematic nodes meeting the bound in 
Q for fc > a + 3. By Corollai-y |8] 



^(™) _ ^l™') 



(45) 



for TO, to' e /c+1, . . . ,n, i — a+1, . . . ,k. Call these matrices 

Consider regeneration of systematic node (a + 3). By 
Lemma [5] components corresponding to systematic nodes 
(a+1) and {a + 2) are to be aligned. Hence we have 



(fe+l,a+3)^(fe+l) _ ^. ^(fe+2,Q+3)^(fe+2) 
„(fe+l,a+3)^(fe+l) _ ^(fc+2,Q+3)^('i-'+2) 



(46) 



- K2X---'--'u;^^2' (47) 

where ki and K2 are some constants in F,. From equation 
(45 1 and since H^+i is full rank (Lemma [3]), this simplifies 
to 



p(i;+l,Q+3)^(fe+l) 



x'--'-'"'iv^-+^-' = Kix^- ' ■ "'A^-^f (48) 



^(fe+2.Q+3)^(fe+2) 



^(fc+l,Q+3) A (fe+1) 



K2X 



(fe+2.a+3)A(fe+2) (49) 



^_(fc+2,a+3) A(fe+2)/.(fc+l) 



K2X 



(fc+2,a+3) A (fe+2)/. (/c+l)^ 
^^a+2 \^^a+2 ) 



(50) 



9 



Since no element of 2;(fc+2:a+3) jg 2ero (Lemma 10 1, and 
the A matrices are diagonal, we get 



- A(*-^+2)/'A(fe+i)\-i rsn 



(fc+l,a+3)^(fe + l)^ 



a+3 



The right hand side of p4| ) is obtained by substituting for 

^(fe+l,a+3) fj-ojj^ 



A'^^+P from (153 I 



Z belongs. Consider a set of variables a^"^^ and 6! 



r,("i) 



TO = fc + 1, 

Let 



,n, i = 1, . . . ,/c, j = 1, . . . ,a, j ^ 



(m) 



Let matrix i?!™' be an a x a matrix such that it has as 
its row, and zeros elsewhere. Also let 

,(m) Am) (m) ,(m) ,(m)i 



Since none of the elements of the diagonal A matrices are 
zero, 

Ki ^ 0, K2 ^ (52) 

Similarly, on regeneration of systematic node a + 2, the 
components along a + 1 and a + 3 have to be aligned. Hence 

'^iAq+I l^a+l J - '«2A„_|_3 (A^_^3 j (53) 

where ki and k2 are some other non-zero constants in ¥q. 

Now, for regeneration of systematic node (a + 3) the 
component provided along it by the first non-systematic node 
is, 



~(m) 
0, 



1 • • • (57) 



Let the node matrix of non-systematic node to (s {k + 
1, •■•,"}) be 

(58) 



(54) 



for i ^ 1, . . . , fc, where la is an a x a identity matrix. 

For example, suppose fc = 5, a — 3 and the systematic 
nodes are grouped as follows: {1, 2}, {3}, {4, 5}. Then, 
the node matrix stored by non-systematic node to, (e {fc + 
1, . . . ,ri}) is 

G(™) = (59) 



For regeneration of systematic node (a + 3) the component 
provided along it by the second non-systematic node is, 

^(fc+2,.+3)A(fe+2)^^^^ 

(55) 

The right hand side of ([55|) is obtained by substituting for 





"1,2 


"1,3 




^2,2 


"2,3 


03" 


















' 










' 



























4"' 



























or-' 


04,1 






4a 


.(,„ 

"5.2 



































group 1 



group 2 



group 3 



From equations p4] i and ( [55| , it is clear that components 
along systematic node (a + 3) node in the vectors passed by 
the two non-systematic nodes are linearly dependent. Hence 
by Lemma |4]regeneration of node (a+3) node is not possible. 

■ 

Since regeneration is not possible by connecting to fc — 1 
systematic nodes and a non-systematic nodes, it will not be 
possible even in a general setting of using any d nodes for 
regeneration. 

VI. A Coding Scheme FOR ANY (fc, a) 

In this section, a coding scheme is described which can be 
used for any (fc, a) parameter set. This scheme assumes that 
when a systematic node fails, the existing fc — 1 systematic 
nodes and any a non-systematic nodes participate in the 
regeneration. This can be easily extended to a more general 
case. 

A. Scheme Description 

Divide the fc systematic nodes into a groups. Similar to the 
scheme given by Wu et al. [2], for regeneration of a systematic 
node, the existing systematic nodes in the same group as the 
failed node pass all their a symbols. The remaining systematic 
nodes and some a non-systematic nodes pass one symbol each. 

The structure of the code is as follows. Let ^{l) e 
{1,...,q;} denote the group to which the systematic node 



7 ) Regeneration: Consider regeneration of systematic node 
I (e {1, . . . , fc}). a non-systematic nodes, say mi, . . . , TOq, 
pass the row of their node matrices. The systematic 

nodes in other groups, say node /' in group ^{V) {^{l') 7^ 
IJ,{1)), pass the vector [0---0 e^^;-, ()---0] where the unit 
vector is in the position I' . Since the component along node I' 
in the vector passed by any non-systematic node is a[™''e^(;), 
it can be subtracted out. The existing systematic nodes in 
group fi{l) pass all their symbols and hence components along 
these nodes can also be cancelled out. Hence, for regeneration, 
the components given out by the non-systematic nodes along 
the direction of the l*'^ systematic node should be linearly 
independent. Thus, regeneration condition for systematic node 
I with this choice of a non-systematic nodes reduces to a 
polynomial being non-zero i.e 



det 



( r(™i) 

r(™2) 
k 



(60) 



for 



Similar polynomials are obtained VZ, and for all sets of a 
non-systematic nodes. Clearly, none of these polynomials are 
identically zero. 

2) Reconstruction: If the data collector connects to the 
fc systematic nodes, then reconstruction is trivially satisfied. 
Consider DC connecting to p non-systematic nodes, and fc — p 
systematic nodes, I < p < k. Let toi, . . . , uip, {nii < . . . < 
TOp) be the non-systematic nodes to which it connects. Let 
li, . . . ,lp, {li < . . . < Ip) be the p systematic nodes to 
which it does not connect. As in Section [riI-B2[ reconstruction 
condition leads to following polynomial not equal to zero 
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t 100 



- Lower bound 

- Our scheme 

- Scheme by Wu et al. 




Fig. 4. Average repair bandwidth(7) required for exact regeneration of the 
systematic nodes with /3 = 1 is plotted for various values of d for k = 9. 



Lemma 12: The average repair bandwidth for exact regen- 
eration of systematic nodes using the above described scheme 
is minimum when the groups are uniformly divided. 

Proof: Directly follows from equation ( [64) l ■ 

Let 

s = lk/a\ (65) 

Uniform division of groups would imply that out of the a 
groups, k mod a groups contain s + 1 nodes each and the rest 
contain s nodes each. 

The average amount of download required for exact regen- 
eration of the systematic nodes in our scheme is compared 
with the scheme proposed by Wu and Dimakis [2] (Group 
interference alignment) in Figure |4] The lower bound on the 
repair bandwidth is also plotted along side. It can be seen 
that for d > 2fc — 1 (i.e. fc < a) our scheme achieves the 
lower bound. For smaller values of d, the amount of data 
downloaded is higher. However, whether this achieved value of 
repair bandwidth is optimal or not is not known for d < 2k— 4. 



condition. 



det 



(nil 



-,(mi 
-,(m2 



or \ 

G 



\ /l 12 



i(mp) 



(61) 



We will now show that there exists an assignment of the 
variables such that this polynomial is not identically zero. Set 



6("' = 



Vi, m 

1 if i = j 

ifi^j 



(62) 
(63) 



By these assignments, the reconstruction matrix becomes an 
identity matrix, which is non-singular Thus, the regeneration 
and reconstruction properties evaluate to the condition of the 
product of certain polynomials being non-zero. It is shown 
that none of these polynomials is identically zero. Assignment 
of values to the variables satisfying all the conditions can be 
obtained using the algorithm given by Koetter and Medard [4] . 

This scheme can be extended to regeneration using any 
combination of systematic and non-systematic nodes provided 
that the systematic nodes in the same group as the failed node 
participate in regeneration. The extended proof will involve a 
few more conditions of polynomials being non-zero. 



B. Analysis 

For fc < a, if all the a nodes are kept in different groups, 
this scheme achieves the minimum repair bandwidth and hence 
is optimal. 

For k > a, the amount of data to be downloaded for exact 
regeneration of a systematic node depends on the number of 
nodes in its group. If there are 77 nodes in a group, the total 
number of symbols required to regenerate a node in that group, 
is given by: 



7 = (?7 - (d- ?7+ 1) 



(64) 
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Appendix 

Proof of Theorem [T] 

Proof: Let uji, . . . ,uJk-p (^j-'i < ... < LiJk-p) be the 
systematic nodes to which DC connects, and rii,...,rip 
(fii < ... < rip) be the p systematic nodes to which it does 
not connect. Thus the sets o^i, . . . , ojk-p and fii, . . . , fip are 
disjoint. Let (5i , . . . , (5p be the p non-systematic nodes to which 
DC connects. The reconstruction matrix R is given by 



R = 



"G 


(«i)- 




.G 







G. 



(-Si) 



G 



(5i 



G, 



(51 



G. 



G. 



(«p) 



G. 



(66) 



Group the fi*'' rows of G'''^""-' (m — 1, . . . ,p) as the first 
p rows of a new matrix R' , then r2|^ rows as the next p rows, 
and so on. Hence, row number fi^ of G'^''"'' becomes the row 
numberpx (i— l)+m in R' . Below these, group the lo*^ rows. 



then the ujf- 



and so on. Row number uj.j of G 



(5,„) 



becomes 



the row number p^ + p x (z — 1) + m in i?'. Hence there are 
a groups with p rows each in R' . 



Let 5* be an p X a matrix with elements [S] i 



(5. 



th 



a. Let Ta,b be an p x a matrix with its b' 
column as [ip^a^' , . . . , V'o*''^]*, and rest of the elements zero. 
Thus, the h*^ column of Ta,b is identical to the a*'' column of 
S. 
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The columns of R' are grouped into p groups of a columns 
each. Thus the matrix R' can be viewed as a block matrix, 
with each block of size px a, and the dimension of R' being 
a y. p blocks. 

Let represent the block of R' . For i = 

1, • ■ ■ J = 1, - ■ • ,P we get 

eS if i = j 



For« = j5+l,...,a, j 



(67) 



1,.. 



(68) 



Thus, 



R! ^ 



eS 

2l2i,Sl2 



eS 



To, 



Ti 



h^^k-p 



(69) 

Let S be the p x p matrix formed by the columns fii , . . . , fip 
of S. As is a submatrix of Cauchy matrix it is invertible. 
Let / be an p X a matrix with columns uji,. . . ,u!k-p having 
some arbitrary values (denoted by (p), and the remaining p 
columns put together forming an identity matrix. Let Ea.b be 
an p X a matrix with the element at position (a, b) as 1 and 
aU other elements 0. 

Multiply each of the a groups of p rows by S"^. This will 
cause the following transformation in i?': S wiU be replaced 
by / and Tji^.b will be replaced by Ea,b- 

The resultant matrix will be of the form: 
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(70) 



In the groups of rows p + 1, . . . , a, every row has exactly 
one non-zero element. Hence these rows and the corresponding 
columns (wi, . . . ,u!k-p) are independent of all others and can 
be eliminated. Note that all the cf) elements are present only in 
these columns and hence the actual values of 4> do not matter. 
The resultant matrix will be a p^ x p^ matrix of the following 
form: 



th 



Other elements 0. 

For i — l,...,p, the z*'' row(column) of the i 
row(column) group respectively contains exactly one non- 
zero element, and hence is Unearly independent of all others. 
After eliminating these rows (and corresponding columns) the 
remaining matrix is rearranged by placing the row(column) 



of the j*'' group adjacent to the j*'* 
group to form: 
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(72) 



••• el 
••• 1 e ^ 

This is a block diagonal matrix, and since ^ 1, is full 
rank. ■ 



In the example of fc = a = 3 considered in section III-A2 
when the data collector connected to the first systematic node, 
and the first two non-systematic nodes, we have p = 2, wi = 



1, rii 
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3, 61 = 4, 62 



5 and e = 2. Here, 
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where /p is a p x p identity matrix and Ea^b is an p x p 
matrix with the element in the position (a, b) as 1 and all 



